This Page Is Inserted by IFW Operations 
and is not a part of the Official Record 

BEST AVAILABLE IMAGES 

Defective images within this document are accurate representations of 
the original documents submitted by the applicant. 

Defects in the images may include (but are not limited to): 

• BLACK BORDERS 

• TEXT CUT OFF AT TOP, BOTTOM OR SIDES 

• FADED TEXT 

• ILLEGIBLE TEXT 

• SKEWED/SLANTED IMAGES 

• COLORED PHOTOS 

• BLACK OR VERY BLACK AND WHITE DARK PHOTOS 

• GRAY SCALE DOCUMENTS 



IMAGES ARE BEST AVAILABLE COPY. 



As rescanning documents will not correct images, 
please do not report the images to the 
Image Problem Mailbox. 
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Dark Edge 
Enhancement 



5x5 Opening Residue 



5x5 Closing Residue 



Horizontal Dispersion 
#Rows = IHeight 



Horizontal Dispersion 
#Rows = IHeight 



Histogram: 5 < 
Rows < IHeight-5 
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Histogram: 5 < 
Rows < IHeight-5 



HMA = Hist Max 
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HMB = Hist Max 
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Save Row Location (Yc) of Max Dispersion 
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Figure 3 



Read Yc, Polarity 
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Create Processing tROI 
(x0,y0) = (0,Yc-3Th) 
(y0,y0) = (IWidth,Yc+3Th) 
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Image Inversion 



Perform Horizontal Dispersion 
In Region defined by tROI 
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compute a, ji, max, min on Dispersion Data 










Save y location (Yph) of peak 
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Apply binary threshold to Dispersion 
Data Threshold = u + a 
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Binary Close binary data result 
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Find top edge and bottom edge of text by 
symmetrically searching through the 
threshold dispersion data starting at 
Yph. A transition of 1 to 0 indicates edge 
of text a = y value resulting from upward 
"0" search b = y value resulting from 
downward "0"search 



•328 



Create Processing tROI 
(x0,y0) - (0, a) 
(xl,yl) - (IWidth,b) 
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Perform Vertical 
Dispersion 

In Region defined by tROI 
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Perform Histogram on Dispersion Data 
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Save x location (Xpv) of peak 
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Apply binary threshold to Dispersion 
Data Threshold vertical = \i + .1 * a 
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Binary Close binary data result 
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Find left edge and right edge of text by 
symmetrically searching through the 
threshold dispersion data starting at Xpv. A 

transition of 1 to 0 indicates edge of text 
c = x value resulting from upward "0" search 
d = x value resulting from downward 
"0"search 
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Adjust Processing tROI 
(x0,y0) = (c, a) 
(xl.yl) = (d,b) 
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Structuring Element (5x5 
neighborhood 3x3 Cross) 
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Read Polarity, tROI, Sharpness 
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Figure 5 
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MaxSlope = 0 
i = 0 
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Read tROI 



Compute Row Number corresponding to = 2/3 tROI 
Height R = 2/3 Row Height 
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Compute 1st Derivative D[i] = 
Pixel Intensity (i+1) - Pixel Intensity (i) 
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D[i] = |D[i]| 
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MaxSlope = Maximum ( MaxSlope, D[i] ) 
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MaxSlope > 30? \ No 




1 



524 



Set TextSharpness = False 



Set TextSharpness = True 
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Read tROI image 
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Read Expected 
Text Width xN 
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Read Expected 
Text Height 
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Determine Actual Text 
Dimensions from tROI Actual 
Height - Yl - Y0 Actual Width = 
(XI -X0) 
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Compute Y and X Scales Factors 
D = Expected Height/Actual Height 
A= Expected Width/Actual Width 



Apply Affine Transformation to 
Image x' = Ax + By + C 
y'= Dx + Ey + F 
where :B = E = C = F = 0 



AdjusttRoi to reflect scaling 
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Figure 7 
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Decompose tRoi into N 
character Roi's (cROI) 
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For cRoi[0] through cRoi[N-l] 
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for y-shift = -2 
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Perform Horizontal Dispersion 
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Compute 2nd order moment for 1- 

dimensional dispersion data 
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Store 2 nd Order Moment m[y-shift]=moment 
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Yes 



Find maximum moment value for 
each of the five y shift values 
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Save y-shift value 
corresponding to maximum 
moment 



Jill 



No 



Last 
cROI 

? 



T 



End 




Yes 



724 



^726 



728 



N values stored which 
represent the optimum 
y-offset. These values will 
be used by the alignment 
and rotation adjustment • 
module 
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Decompose tRoi into N 
character Roi's (cROI) 



'804 



For cRoi[0] through cRoi[N-l] 
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Apply optimal y-offset for cRoi 



angle = minAngle 
Rotate cRoi by specified degrees 
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Perform Horizontal Dispersion 



Perform Vertical Dispersion 
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Compare Max of Vert. & Horiz. Dispersion 



Compute 2 nd order moment for 
1- dimensional dispersion data 
yielding the maximum amplitude 
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Store 2nd Order Moment m[angle]=moment 
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Increment angle 

No / An S ,e > 
\MaxAngle? 
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Yes 



Find maximum moment value 
for each of the six angles 
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Save angle corresponding 
to maximum moment 
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N values stored which 
represent the optimum 
y-offset These values will be 
used by the alignment and 
rotation adjustment module 
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Apply optimal y-offset to cRoi 
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Figure 13 



Figure 15 
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Close 25 x 
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Grayscale 
Accumlation 
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Vertical Dispersion 
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X Position 



Figure 16 
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Perform Histogram 








Analyze Populations 








Calculate Optimal 
Threshold 
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Apply Threshold 
To Grayscale Region 
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Decompose String Region 
Into 18x20 Character 
Regions 
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To Correlation 
Engine 
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select character set 
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divide character 
templates into an 
initial set of regions 
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Figure 17 
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select an initial weighting 
(a,p,$..) for combination of 
regional correlation results Q 

with one region obscured 
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For each character, compute 
SCtot(p) = S[aC, +PC 2 + ...] 
sum over all p 
for one obscured region 
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save regio^ 
obscurement result 
Ri= SCtot(p) 
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Obscure a different region 
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change region 
design to maximize 

FOM: 
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determine the probability in the 

particular application that a 
region, will be obscured (OP,) 
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compute a total figure of merit 
for character correlation with 
one region obscured 
FOMj =Hl-OPi)Ri 
sum over ail i 
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